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ABSTRACT 

Aircraft  navigation  information  (position,  velocity,  and  at¬ 
titude)  can  be  determined  using  optical  measurements  from 
an  imaging  sensor  pointed  toward  the  ground  combined 
with  an  inertial  navigation  system.  A  critical  factor  gov¬ 
erning  the  level  of  accuracy  achievable  in  such  a  system 
is  the  alignment  and  calibration  of  the  sensors.  Currently, 
alignment  accuracy  is  limited  by  machining  and  mounting 
tolerances  for  low-cost  applications. 

In  this  paper,  a  novel  alignment  and  calibration  method  is 
proposed  which  combines  inertial  and  stellar  observations 
using  an  extended  Kalman  filter  algorithm.  The  approach  is 
verified  using  simulation  and  experimental  data,  and  con¬ 
clusions  regarding  alignment  accuracy  versus  sensor  qual¬ 
ity  are  drawn. 


Motivation 

The  development  of  low-cost  inertial  and  optical  sensors 
has  led  to  remarkable  advances  in  the  field  of  optical-aided 
navigation  (e.g.,  [14],  [15]).  In  these  systems,  digital  im¬ 
ages  are  combined  with  inertial  measurements  to  estimate 
position,  velocity,  and  attitude.  The  relative  orientation  be¬ 
tween  the  inertial  and  optical  sensors  is  a  critical  quantity 
which  must  be  determined  prior  to  operation  of  the  system. 
The  accuracy  with  which  the  relative  orientation  is  known 
effectively  sets  the  lower  bound  for  the  navigation  accuracy 
of  the  system. 

In  this  paper,  current  alignment  methods  are  discussed,  and 
a  novel  method  is  presented  which  addresses  the  short¬ 
comings  of  the  current  techniques.  The  algorithm  is  then 
tested  using  both  simulated  and  flight  data.  Finally,  conclu¬ 
sions  are  drawn  regarding  the  fundamental  limits  of  accu¬ 
racy  achievable  given  various  system  parameters  and  align¬ 
ment  procedures.  This  work  is  part  of  ongoing  research 
into  fusion  of  optical  and  inertial  sensors  for  long-term  au¬ 
tonomous  navigation  [12], 

Current  Methods 

The  ultimate  goal  of  the  alignment  process  is  to  determine 
the  relative  orientation  between  an  optical  and  inertial  sen¬ 
sor,  or  more  specifically,  the  sensitive  axes  of  both  sensors. 
The  methods  used  to  estimate  this  orientation  fall  into  two 
categories:  mechanical  and  estimation-based  techniques. 

Mechanical  techniques  use  mechanical  measurements 
(such  as  laser  theodolites)  to  determine  the  relative  orienta¬ 
tion  between  known  fiducials  on  each  sensor.  This  method 
requires  knowledge  of  the  relationship  between  the  sensi¬ 
tive  axes  of  the  sensors  and  the  external  reference  fiducials, 
which  is  subject  to  unknown  manufacturing  errors.  In  ad¬ 
dition,  depending  on  the  required  accuracy,  this  method  re¬ 
quires  external  equipment  which  is  not  suitable  for  use  in 
the  field. 
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Estimation-based  techniques  utilize  actual  sensor  measure¬ 
ments  while  subjecting  the  system  to  known  conditions. 
In  [8],  the  sensors  are  mounted  on  a  calibrated  pendulum 
while  imaging  a  reference  pattern.  The  orientation  of  the 
scene  detected  by  the  optical  sensor,  combined  with  the 
current  local  gravity  vector,  is  used  to  estimate  the  relative 
orientation  and  inertial  sensor  biases. 

These  current  approaches  require  dedicated  equipment 
which  would  increase  the  difficulty  of  field  calibrations. 
In  addition,  these  “captive”  techniques  separate  the  cali¬ 
bration  and  navigation  functions  of  the  system  and  can¬ 
not  compensate  for  time-varying  errors  due  to  temperature 
changes,  flight  profile,  flexure  modes,  etc.  In  the  next  sec¬ 
tion,  the  basis  for  a  real-time  estimator  which  incorporates 
measurements  of  visual  objects  at  known  locations,  inertial 
measurements,  and  position  updates  is  developed.  More 
specifically,  the  field  of  visible  stars  is  used  to  provide  the 
reference  for  the  optical  system. 

The  method  proposed  in  this  paper  has  several  advantages 
over  the  current  approaches.  First,  the  system  is  automatic 
and  requires  no  operator  involvement  or  external  equip¬ 
ment.  Secondly,  this  method  is  not  limited  to  stationary 
operation  and  can  be  accomplished  during  a  mission.  In 
fact,  maneuvers  can  actually  improve  the  observability  of 
inertial  sensor  errors  [13],  Finally,  the  recursive  estimation 
approach  allows  the  system  to  account  for  time-varying  er¬ 
rors  (e.g.,  accelerometer  and  gyroscope  bias)  in  a  more  rig¬ 
orous  fashion  than  batch  approaches. 

There  are  some  obvious  disadvantages  to  using  stellar  ob¬ 
servations  which  must  be  considered.  Stellar  observations 
require  visibility  of  the  sky  or  portions  of  the  sky.  In  addi¬ 
tion,  the  imaging  system  must  be  of  appropriate  sensitivity 
and  measurement  fidelity  to  resolve  the  location  of  celestial 
objects. 

DEVELOPMENT 

The  method  proposed  in  this  paper  employs  an  extended 
Kalman  filter  (EKF)  algorithm  (see  [10],  [11])  to  recur¬ 
sively  estimate  camera  alignment  and  calibration  param¬ 
eters  by  measuring  the  pixel  locations  of  celestial  objects 
in  an  image-aided  inertial  system. 

Assumptions 

This  method  is  based  on  the  following  assumptions. 

•  A  strapdown  intertial  measurement  unit  (IMU)  is 
rigidly  attached  to  a  camera.  Synchronized  raw  mea¬ 
surements  are  available  from  both  sensors. 

•  The  sensors  are  located  at  either  a  fixed,  known  loca¬ 
tion  or  external  position  measurements  are  available 


for  a  moving  trajectory  (e.g..  Global  Positioning  Sys¬ 
tem). 

•  A  star  tracking  algorithm  is  available  which  can  iden¬ 
tify  and  track  celestial  objects. 

Algorithm  Description 

In  order  to  provide  the  maximum  flexibility  with  respect  to 
either  fixed  or  moving  trajectories,  the  estimator  combines 
inertial  measurements,  optical  measurements  of  known 
stars,  and  external  position/velocity  measurements.  The 
system  parameters  (see  Table  1)  consist  of  the  navigation 
parameters  (position,  velocity,  and  attitude),  inertial  mea¬ 
surement  biases,  and  camera  alignment  and  scale  factor  pa¬ 
rameters.  The  navigation  parameters  are  calculated  using 
velocity  increment  (Avb)  and  angular  increment  (A 6bib) 
measurements  from  the  inertial  navigation  sensor  which 
have  been  corrected  for  bias  errors  using  the  current  bias 
estimates.  These  measurements  are  integrated  from  an  ini¬ 
tial  state  in  the  navigation  (local-level)  frame  using  mecha¬ 
nization  algorithms  described  in  [16], 


Table  1:  System  Parameter  Definition 


Parameter 

Description 

pn 

Vehicle  position  in  navigation  frame 
(latitude,  longitude,  altitude) 

v" 

Vehicle  velocity  in  navigation  frame 
(north,  east,  down) 

r^n 

Vehicle  body  to  navigation  frame  DCM 

ab 

Acclerometer  bias  vector 

bb 

Gyroscope  bias  vector 

c* 

Camera  to  vehicle  body  frame  DCM 

Sx 

Camera  image  plane  vertical  scale  factor 

sy 

Camera  image  plane  horizontal  scale  factor 

An  Extended  Kalman  Filter  was  constructed  to  estimate  the 
errors  in  the  calculated  system  parameters.  In  order  to  min¬ 
imize  the  effects  of  linearization  errors,  the  system  param¬ 
eters  were  periodically  corrected  by  removing  the  current 
error  estimate  (see  [10]).  A  block  diagram  of  the  system  is 
shown  in  Figure  1. 

The  Kalman  filter  state  vector,  x,  is  defined  as 

‘  5pn 

Svn 

„  <5ab 

X~  Sbb 

a 

Ssx 
.  Ssy 
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Figure  1:  Camera  calibration  extended  Kalman  filter  block 
diagram.  In  this  filter,  surveyed  position  or  GPS  pseudo¬ 
range  measurements  and  optical  measurements  of  known 
stars  are  used  to  estimate  trajectory  errors  from  a  refer¬ 
ence  trajectory  provided  by  an  inertial  navigation  system 
(INS).  The  errors  are  then  “fed-back”  and  subtracted  from 
the  INS  trajectory  in  order  to  keep  the  reference  trajectory 
as  close  as  possible  to  the  true  trajectory. 


where  5 p"  is  the  estimated  position  error  vector,  bv"  is 
the  estimated  velocity  error  vector,  and  if  is  the  estimated 
body-to-navigation  frame  attitude  error  (defined  as  small- 
angle  rotations  about  the  north,  east,  and  down  axes).  The 
accelerometer  and  gyroscope  bias  errors  are  represented  by 
5&b  and  bb6,  respectively.  The  camera  alignment  errors  are 
represented  by  a  (defined  as  small  angle  rotations  about  the 
camera  x,y,  and  z  axes)  and  scale  factor  by  6sx,6sy  (defined 
later  in  Eqn.  (5)). 

The  position,  velocity,  and  attitude  errors  were  modeled 
as  a  stochastic  process  based  on  the  well-known  Pinson 
navigation  error  model  [16].  The  accelerometer  and  gyro¬ 
scopic  bias  errors  were  each  modeled  as  a  first-order  Gauss- 
Markov  process  [10],  based  on  the  specification  for  the  in¬ 
ertial  measurement  unit  (IMU).  The  camera  misalignment 
and  scalefactor  errors  are  modeled  as  unknown  biases.  A 
small  amount  of  process  noise  is  added  to  the  state  dynam¬ 
ics  to  promote  filter  stability  [11], 

Celestial  Measurement  Model 


cosine  matrix.  Using  the  pinhole  camera  model  described 
in  [9],  the  pixel  location,  z(t,),  is  a  function  of  the  camera 
projection  matrix,  II, 


z{ti)  =  IIs®(fj)  +  v(U)  (3) 

where  s®  (i)  is  the  homogeneous1  form  of  the  object  direc¬ 
tion  vector  in  the  camera  frame.  In  this  paper,  an  underbar 
indicates  the  homogeneous  form  of  the  vector  (e.g.,  s  is  the 
homogeneous  form  of  s).  The  measurement  is  corrupted 
by  v,  a  zero-mean,  white,  Gaussian  noise  process  with  co- 
variance 


E  [v( [ti)-vt(tj)_ 


K  t-i  —  tj 
0  tj  ^  tj 


(4) 


The  projection  mattix  is  given  by 


n  = 


Sx  0  bx 

0  Sy  by 


(5) 


where  sx  and  sy  are  camera  scaling  parameters  in  the  x 
and  y  directions,  respectively  and  bx  and  bv  are  the  known 
x  and  y  location  of  the  image  plane  origin.  Note  that  the 
image  plane  origin  effectively  defines  the  camera  z  axis,  so 
the  values  of  bx  and  bv  are  not  modeled  as  states. 


Thus  the  pixel  measurement  of  a  star’s  location  is  a  non¬ 
linear  function  of  the  true  state  corrupted  by  additive  white 
Gaussian  noise,  and  is  represented  by 

z  =  h[p”,C^,C  bc,sx,sy\+v  (6) 

or,  equivalently, 

z  =  h  [x]  +  v  (7) 

The  linearized  observation  matrix,  H,  is  the  Jacobian  of  the 
nonlinear  measurement  function,  h[-],  linearized  about  the 
reference  trajectory,  x: 


(8) 


The  partial  derivatives  are  calculated  about  the  reference 
trajectory,  starting  with  the  camera  scale  factor  states.  Us¬ 
ing  Equation  (3)  as  a  reference,  the  partial  derivatives  are 


The  celestial  measurement  is  simply  the  current  pixel  loca¬ 
tion  of  an  identified  celestial  object.  Celestial  object  n  is 
located  at  a  known  direction  relative  to  the  Earth  (based  on 
astronomical  almanac  data)  [7],  and  is  represented  by  the 
unit  vector,  s®  (tf),  at  time  fj  [4].  The  object  direction  vec¬ 
tor  in  the  camera  frame,  s®  (tj),  is  a  function  of  the  vehicle 
position,  vehicle  orientation,  and  camera-to-body  orienta¬ 
tion: 

s®  (U)  =  C{jC^C"s®  (U)  (2) 

where  C™  is  the  Earth  frame  to  navigation  frame  direction 


dh  <9h 

It  o  1 

.  y  _ 

-*-2x2  q 

(9) 


The  partial  derivative  with  respect  to  position  is  expressed 
by 


dh  =  ndgn 
dpn  dpn 


(10) 


’The  homogeneous  form  of  a  vector  is  that  vector  augmented 
with  a  “1”.  The  homogeneous  form  of  the  vector  [  x  y  ]7'  is 
[  x  y  1  ]T. 


where. 


Updates 


dg  n 

<9p" 


<9s^  c  <9s^ 

9pn  — ' n  dpn 


and, 


^Sn 

<9pn 


Ccbcbn  [  X!  |  x2 


03x1 


3x3 


where 


(11) 


(12) 


(13) 

(14) 


The  partial  derivative  with  respect  to  body-to-navigation 
frame  misalignment  angle  vector,  ip,  is 


5h  =  dg, 

dip  Dip 


(15) 


where 


and 


dst 


ds  n  dip  —n  dip 

dip 


dnc 

g^  =  CcbCbn  [(CX)x] 


(16) 


(17) 


The  skew  symmetric  operator,  (-)x,  is  defined  as 


'  SL  " 

0 

—  sc 

^nz 

Snv 

scnx  = 

X  = 

Snz 

0 

~Snx 

L  J 

.  -Sny 

cc 

^nx 

0 

(18) 


Finally,  the  partial  derivative  with  respect  to  the  camera-to- 
body  frame  misalignment  angle,  a,  is 


dh  =  ndg„ 

da  da 


where 


and 


»„c  „c 

US.n  _  da  -n  da 

da  s2, 

ltz 


gg  =  CJ  [(CjCX)  x] 


All  other  partial  derivatives  are  zero. 


(19) 


(20) 


(21) 


The  resulting  observation  matrix  is 


H  = 


<9h  p  Oh  Oh  Oh  Oh  1 

0pn  3x3  d'tjj  3x6  qSx  QSy  J 

(22) 


As  mentioned  previously,  position  measurements  are  also 
used  to  update  the  Kalman  filter.  For  this  research,  sur¬ 
veyed  position  and  zero  velocity  values  are  used  to  up¬ 
date  the  filter  during  stationary  profiles.  During  flight  pro¬ 
files,  single-channel  pseudorange  measurements  from  the 
Global  Positioning  System  (GPS)  are  utilized.  An  example 
of  a  tightly  coupled  GPS  measurement  model  is  presented 
in  [1]. 

RESULTS 

The  estimation  algorithm  was  tested  using  both  simulated 
profiles  and  a  real  profile  flown  on  a  T-38  aircraft.  Sim¬ 
ulations  were  constructed  to  determine  the  estimation  ac¬ 
curacy,  robustness,  and  sensitivity  of  the  algorithm.  The 
flight  data  were  used  to  demonstrate  observability  of  the 
camera  calibration  states  during  operational  scenarios.  In 
addition,  the  flight  data  helped  to  verify  the  accuracy  of  the 
astronomical  almanac  calculations. 

Simulation 

The  simulations  were  based  on  a  stationary  profile  designed 
to  provide  strong  observability  of  the  IMU  biases  and  cam¬ 
era  calibration  parameters.  This  was  achieved  by  periodi¬ 
cally  changing  the  orientation  of  the  sensor  in  increments 
of  60  degrees  while  maintaining  a  view  of  the  sky.  The 
stationary  profile  is  shown  in  Table  2. 


Table  2:  Stationary  camera  calibration  profile.  The  profile 
was  designed  to  provide  strong  observability  of  IMU  biases 
while  maintaining  a  view  of  the  sky. 


Segment 

Roll  (deg) 

Pitch  (deg) 

Hdg  (deg) 

1 

+60 

0 

0 

2 

-60 

0 

0 

3 

-60 

0 

60 

4 

+60 

0 

60 

5 

+60 

0 

120 

6 

-60 

0 

120 

The  simulations  were  conducted  using  three  IMU  models 
representing  samples  from  consumer  grade,  tactical  grade, 
and  navigation  grade  sensors.  The  camera  model  was  based 
on  the  gated-intensified  CCD  camera  used  during  the  Peep¬ 
ing  Talon  flight  tests  [12].  The  camera  produced  480  by 
720  pixel  interlaced  images  with  a  field  of  view  of  approxi¬ 
mately  10  by  15  degrees.  Image  updates  were  processed  at 
five-second  intervals. 

The  IMU  models  represent  typical  performance  of 
consumer-grade,  tactical  grade,  and  navigation  grade  sen¬ 
sors.  The  measurement  parameters  for  each  sensor  are 


Table  3:  Inertial  measurement  sensor  specifications  for  the  Cloud  Cap  Technology  Crista  consumer-grade  IMU  [2  ],  Honeywell 
HG1700  tactical-grade  IMU  [5],  and  Honeywell  HG9900  navigation-grade  IMU  [6],  The  parameters  noted  with  an  asterisk 
were  not  included  in  the  specifications  and  are  estimates. 


Parameter  (Units) 

Sampling  interval  (ms) 

Gyro  bias  sigma  (deg /hr) 

Gyro  bias  time  constant  (hr) 
Angular  random  walk  (deg /s/hr) 
Gyro  scalefactor  sigma  (PPM) 
Accel  bias  sigma  (m/s2) 

Accel  bias  time  constant  (hr) 
Velocity  random  walk  (m/s/ s/hr) 
Accel  scalefactor  sigma  (PPM) 

listed  in  Table  3. 

Monte-carlo  simulation  results  show  that  the  algorithm  ac¬ 
curately  and  robustly  estimates  both  the  camera  to  body 
alignment  and  camera  scale  factor  parameters.  Sample  er¬ 
ror  functions  are  shown  for  the  HG1700  IMU  sensor,  which 
are  representative  of  the  ensemble,  in  Figures  2,  3,  4,  and 
5.  The  rotations  in  the  alignment  profile  clearly  improve 
the  observability  of  the  camera  alignment  parameters  as  the 
filter  errors  (and  uncertainty)  decrease  after  each  rotation 
maneuver.  Note  the  alignment  angles  are  essentially  unob¬ 
servable  until  the  first  rotation  maneuver.  The  scale  factor 
parameters’  observability  is  largely  independent  of  maneu¬ 
vers,  especially  with  a  well-populated  starfield.  This  would 
not  be  the  case  with  a  small  number  of  available  star  mea¬ 
surements. 


GPS  Time  (s) 


Figure  2:  Typical  camera  to  body  alignment  estimation  ac¬ 
curacy  for  the  Crista  IMU  during  the  simulated  alignment 
profile.  The  solid  line  represents  the  filter  angular  esti¬ 
mation  errors  and  the  dotted  line  represents  the  estimated 
standard  deviation  of  the  errors. 
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Figure  3:  Typical  camera  scale  factor  estimation  accuracy 
for  the  Crista  IMU  during  the  simulated  alignment  profile. 
The  solid  line  represents  the  filter  angular  estimation  er¬ 
rors  and  the  dotted  line  represents  the  estimated  standard 
deviation  of  the  errors. 

A  qualitative  estimate  of  achievable  camera  to  body  align¬ 
ment  accuracy  for  various  inertial  sensor  models  as  a  func¬ 
tion  of  gyroscope  random  walk  is  shown  in  Figure  6.  As 
expected,  improving  the  quality  of  the  inertial  sensor  yields 
improved  alignment,  up  to  the  accuracy  of  the  image  sen¬ 
sor  to  resolve  the  star  locations.  In  this  case,  the  camera 
alignment  estimate  for  the  HG9900  is  limited  by  the  im¬ 
age  measurements.  This  could  be  improved  by  increasing 
the  angular  sampling  frequency  of  the  imaging  sensor  [3], 
A  sensitivity  analysis  was  performed  by  creating  theoreti¬ 
cal  combinations  of  accelerometer  and  gyroscopic  sensors 
and  estimating  the  boresight  alignment  accuracy  using  the 
standard  alignment  profile.  The  results,  shown  in  Table  (4), 
indicate  the  performance  of  the  gyroscope  has  a  stronger 
contribution  to  the  achievable  boresight  accuracy,  although 
both  sensors  influence  the  ultimate  performance  due  to  cou- 
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Figure  4:  Typical  camera  to  body  alignment  estimation 
accuracy  for  the  Honeywell  H-1700  IMU  during  the  sim¬ 
ulated  alignment  profile.  The  solid  line  represents  the  filter 
angular  estimation  errors  and  the  dotted  line  represents  the 
estimated  standard  deviation  of  the  errors. 


Figure  5:  Typical  camera  scale  factor  estimation  accu¬ 
racy  for  the  Honeywell  HG1 700  IMU  during  the  simulated 
alignment  profile.  The  solid  line  represents  the  filter  an¬ 
gular  estimation  errors  and  the  dotted  line  represents  the 
estimated  standard  deviation  of  the  errors. 


pling  between  accelerometer  and  gyro  error  states. 

These  results  illustrate  the  relationship  between  the  accu¬ 
racy  of  the  optical  and  inertial  sensors  and  the  ability  to 
determine  the  relative  orientation  of  the  sensors.  More  fun¬ 
damentally,  even  if  a  mechanical  or  other  method  existed  to 
provide  a  “better”  alignment  (e.g.,  relative  to  the  “case”),  it 
would  be  impossible  to  prove  as  the  sensor  measurements 
limit  the  observability  of  the  relative  alignment. 

T-38  Flight  Data  Collection 

In  order  to  test  the  algorithm,  a  flight  test  was  performed  at 
Edwards  Air  Force  Base  as  part  of  the  joint  AFIT/Test  Pi¬ 
lot  School  (TPS)  program.  The  test  platform  consisted  of  a 
T-38  aircraft,  with  the  test  configuration  shown  in  Figure  7. 
The  gated-intensified  CCD  camera  was  mounted  inside  the 
canopy,  pointing  out  of  the  right  side  of  the  aircraft.  The 
images  were  recorded  using  a  Sony  digital  video  recorder, 
and  a  GPS  time  tag  (accurate  to  1  ms)  was  generated  by 
a  time-code  generator  and  time  inserter,  and  recorded  di¬ 
rectly  onto  the  video  image.  A  liquid  crystal  display  (FCD) 
monitor  was  provided  for  the  pilot  to  see  the  camera  images 
during  the  flight. 

The  inertial  measurements  were  obtained  from  a  Honey¬ 
well  H-764G  (HG9900  core)  Embedded  GPS/INS  (EGI) 
navigation  system  modified  to  produce  high  rate  (256  Hz) 
raw  Av6  and  A 0bib  measurements.  Finally,  an  Ashtech  Z- 
surveyor  semi-codeless  receiver  was  used  to  collect  dual¬ 
frequency  GPS  measurements.  The  FI  -C/A  code  pseudor¬ 
ange  measurements  were  used  to  provide  a  position  update 
source  to  the  Kalman  filter  during  the  profile.  A  second  Z- 


surveyor  was  used  as  a  differential  reference  station,  and  a 
carrier-smoothed  code  differential  GPS  trajectory  was  gen¬ 
erated  to  serve  as  a  precise  truth  trajectory. 

The  camera  calibration  estimation  was  conducted  during  a 
left  turning  profile,  which  provided  an  unobstructed  view 
of  the  sky.  A  total  of  92  images  were  used  to  update  the 
Kalman  filter  during  a  45  second  period.  The  first  image 
used  as  a  measurement  is  shown  in  Figure  8.  The  filter’s 
estimate  of  the  stars  locations  along  with  covariance  el¬ 
lipses  are  overlayed  on  the  image.  This  first  image  shows 
relatively  large  uncertainty  ellipses,  indicating  a  high  level 
of  uncertainty  in  the  camera  calibration.  Figure  9  shows 
the  second  image  measurement.  After  incorporating  the 
first  image  measurement,  the  uncertainty  ellipses  have  col¬ 
lapsed,  which  indicates  the  filter  has  increased  confidence 
in  the  camera  calibration.  In  addition,  the  tracked  stars  ap¬ 
pear  within  their  respective  ellipses,  which  indicates  the  fil¬ 
ter  has  estimated  the  camera  calibration  properly. 

The  estimated  uncertainty  of  the  camera  alignment  and 
scale  factor  states  are  shown  in  Figures  10  and  11,  respec¬ 
tively.  Note  the  filter  achieves  a  nearly  steady-state  level 
of  confidence  after  approximately  15  seconds  of  image  up¬ 
dates. 


Table  4:  Camera  to  inertial  alignment  accuracy  accelerometer  /  gyroscope  performance  sensitivity.  Theoretical  alignment 
performance  (in  1  —  a  RMS  arcseconds)  is  shown  as  a  function  of  various  combinations  of  sensors  from  the  Crista,  HG1700, 
and  HG9900  IMUs  after  completing  the  standard  alignment  profile. 
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Figure  6:  Typical  camera  to  inertial  alignment  accuracy 
for  various  grades  of  IMU.  Specific  results  are  shown  for 
the  Crista.  HG1700.  and  HG9900  IMUs  after  comvletine 
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Figure  10:  Estimated  uncertainty  of  camera  to  body  align¬ 
ment  during  T-38  flight  profile.  Celestial  image  updates 
were  available  for  approximately  38  seconds. 


Figure  7:  Northrop  T-38  instrumented  with  synchronized 
digital  video  camera  and  inertial  navigation  system. 
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Figure  11:  Estimated  uncertainty  of  camera  scale  factor 
parameters  during  T-38  flight  profile.  Celestial  image  up¬ 
dates  were  available  for  approximately  38  seconds. 


GPS  Time:  269484.635 


Figure  8:  Initial  celestial  update  from  Peeping  Talon  data  collection.  The  position  of  the  tracked  stars  is  shown  by  a  plus  (+) 
symbol.  The  ellipses  represent  the  Kalman  filter’s  uncertainty  of  the  true  pixel  location  of  each  star. 
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ond  celestial  update  from  Peeping  Talon  data  collection.  The  position  of  the  tracked  stars  is  shown  by  a  plus  (+) 
llipses  represent  the  Kalman  filter’s  uncertainty  of  the  true  pixel  location  of  each  star. 


CONCLUSIONS 

In  this  paper,  an  algorithm  is  presented  to  estimate  the 
camera  calibration  parameters  of  an  optical-inertial  system 
utilizing  stellar  observations  and  inertial  measurements  in 
situ.  The  algorithm  is  robust  and  suitable  for  various  qual¬ 
ity  inertial  sensors  and  trajectories,  provided  a  position  ref¬ 
erence  is  available.  As  expected,  the  alignment  quality 
achievable  is  a  function  of  the  accuracy  of  the  inertial  mea¬ 
surement  unit  and  imaging  sensor.  In  addition,  profiles  with 
angular  changes  are  shown  to  improve  system  observability 
through  simulation. 

DISCLAIMER 

The  views  expressed  in  this  article  are  those  of  the  au¬ 
thor  and  do  not  reflect  the  official  policy  or  position  of  the 
United  States  Air  Force,  Department  of  Defense,  or  the  U.S 
Government. 
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